Characteristics of scientific Web publications: Preliminary data gathering and analysis

of the increasing presence of scientific publications on the Web, combined with the existing difficulties in easily verifying and retrieving these publications, research on techniques and methods for retrieval of scientific Web publications is called for. In this article, we report on the initial steps taken toward the construction of a test collection of scientific Web publications within the subject domain of plant biology. The steps reported are those of data gathering and data analysis aiming at identifying characteristics of scientific Web publications. The data used in this article were generated based on specifically selected domain topics that are searched for in three publicly accessible search engines (Google, AllTheWeb, and AltaVista). A sample of the retrieved hits was analyzed with regard to how various publication attributes correlated with the scientific quality of the content and whether this information could be employed to harvest, filter, and rank Web publications. The attributes analyzed were inlinks, outlinks, bibliographic references, file format, language, search engine overlap, structural position (according to site structure), and the occurrence of various types of metadata. As could be expected, the ranked output differs between the three search engines. Apparently, this is caused by differences in ranking algorithms rather than the databases themselves. In fact, because scientific Web content in this subject domain receives few inlinks, both AltaVista and AllTheWeb retrieved a higher degree of accessible scientific content than Google. Because of the search engine cutoffs of accessible URLs, the feasibility of using search engine output for Web content analysis is also discussed. Introduction The Web has a significant impact on the practice in scientific publication. According to Cronin and McKim (1996, p. 170), the Web is reshaping the ways in which scholars communicate with one another, i.e., new kinds of scholarly and proto-scholarly publishing are emerging, which means that work-in-progress, broadsides, early drafts, and refereed articles are now almost immediately sharable. Nevertheless, only a minor part of these scientific publications is accessible through the Web, because they are difficult to control (i.e., to find, identify, access, and assess). In February 1999 Lawrence and Giles (1999, p. 107) estimated that only 6% of randomly selected Web sites contained scientific or educational content, defined as university, college, and research lab servers. It is an open question whether content of a scientific nature should solely be found in those domains. In response to this question, Björneborn and Ingwersen (2001, p. 69) explain …